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1 Introduction 


In our AFOSR work, we have carried out an extensive research program for the study of robust 
system control using methodologies from interpolation theory, dilation theory, and functional 
analysis. We have also become interested in image processing and computer vision, and their 
application to visual tracking problems. 

First of all, we devoted a large portion of our research effort to nonlinear systems. This has 
led us to derive an iterative commutant lifting theorem which gives an explicit design procedure 
for nonlinear systems and captures the ^“-control problem in the nonlinear framework [51], 
[52], [53]. We are of course interested in computer implementations of this work. In this area, 
we have defined a notion of rationality for nonlinear systems, and we have proven that the 
iterative commutant lifting procedure produces rational controllers (in this nonlinear sense) 
if we start from rational data. The procedure has already been applied to certain systems 
(connected with the National Aerospace Plane) with input saturations (in collaboration with 
colleagues at the Systems Research Center of Honeywell in Minneapolis). Moreover, these 
ideas are presently being applied to a disturbance attenuation problem in connection with 
the control of the ATB-1000 Testbed which models the gun turret of the Apache helicopter 
(in collaboration with control engineers at the Picatinny Arsenal in New Jersey) [24, 25]. 
This framework has also led to new directions in introducing notions of causality [54] in 
commutant lifting theory, and moreover has led to the possible formulation of a global non¬ 
linear commutant lifting theorem as a saddle-point result. We are particularly interested in 
the treatment (and understanding the control limitations) of “hard” nonlinearities such as 
dead-zone, backlash, and saturation. These ideas will be explained below in our Proposed 
Work. 

During the research period supported by AFOSF -J-0024, we also developed novel inter¬ 
polation methods which are not norm-based. Tht ^ve arisen out of our research into the 
multivariable gain margin problem as well as the more general structured singular value. We 
believe that this new type of interpolation theory should lead to several interesting directions 
in operator theory as well. 

More precisely, our work on the multivariable gain margin problem, has led to a novel 
interpolation scheme which we call spectral Nevanlinna-Pick interpolation and the more 
general structured interpolation theory; see [19], [18], [20], and [23]. This involves matrix 
interpolation in which one bounds the spectral radius, and not the norm of the interpolants 
as in ordinary Nevanlinna-Pick theory. (Ordinary Nevanlinna-Pick is precisely the type of 
mathematical problem that arises in standard H°° synthesis.) We now have a theoretical pro¬ 
cedure for solving this spectral interpolation problem both in its pure matricial and tangential 
formulations. 

Our solution involves a generalization of the commutant lifting theorem, and a new object 
of interest in linear algebra and operator theory which we call the T-spectral radius. We 
are presently studying both the theoretical and practical ramifications of our solution, and 
we would like to develop software for the computation of the T-spectral radius. In our new 
research, we have been concentrating on the generalization of these results to the structured 
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singular value of Doyle and Safonov in order to try to develop an analytic p -synthesis proce¬ 
dure [20]. Closely related to this work is a novel lifting technique which allows us to study 
the robust stability analysis of systems under various kinds of structured perturbations which 
we will consider below. (See also [13], [14], [16], and [86].) This lifting technique allows one 
to interpret the upper bound for the structured singular value p defined in terms of certain 
scalings as a structured singular value on a larger space. Moreover, we will discuss below 
a new approach for the approximation of Riemann mappings (conformal equivalences from 
simply connected sub-domains of the complex plane to the unit disc) for the application of 
solving the gun-phase margin problem [66]. 

We have continued our research on the utilization operator theoretic methods in /re¬ 
optimization theory using skew Toeplitz operators (see [17] for the precise definition), which 
seem ideally suited for studying H°° design problems, especially for distributed (i.e., infinite 
dimensional) systems. These methods are quite natural in the control context since they allow 
one to do design just using the input/output operators. This has led to an explicit solution 
of the four block problem for large class of multivariable distributed systems. (This is 
the most general if 00 -optimization problem.) The procedure seems to be numerically robust 
as evidenced by its implementation at the Systems Research Center of Honeywell, and its 
application to a number of distributed plant models including a flexible beam [70], and an 
unstable delay system associated with the flight control of the X-29 [35]. A nice feature of 
this approach is that the complexity of the computations only depends on the the weighting 
matrices (modelling the disturbances) and not on the plant (which may be distributed). Since 
the weighting matrices are typically taken to be rational, this approach seems very efficient 
even in the finite dimensional case for plants with large state spaces. We have also been 
developing methods for the utilization of an operator due to Young [94] in order to simplify 
some of our computations in the standard problem for multivariable systems. 

Recently there has been a large amount of work devoted to state space approaches to H°° 
optimization; see [3], [33], [58] and the references therein. In our AFOSR research, we have 
verified a formula which combines the state and frequency approaches to if “-optimal design in 
the one block (sensitivity minimization) case [71], [96]. We will also be interested in extending 
this to the more general two and four block frameworks. This type of formula should combine 
the advantages of both the elegant state space (Riccati equation) and frequency domain 
(input/output) approaches to H°° theory. 

Next using the one-step dilation procedure, we have given a way of parametrizing the 
suboptimal controllers for such generalized interpolation problems [43]. This has led to a 
scheme for designing suboptimal finite dimensional controllers for distributed systems in the 
one block setting [77]. We would like to continue this direction for the general standard 
problem, as well as apply the techniques to a number of design problems. Some steps in this 
direction have already been taken in [35], [70], and [72]. 

Closely related to the above work has been the use of S°° techniques to study sampled- 
data control. See [11] and the references therein. Here one can use a certain operator-theoretic 
lifting method to describe a complete solution to the analysis problem of verifying that a given 
controller constrains the £ a -induced norm of the sampled-data system to be less than some 
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pre-spedfled level. (In fact, the lifting method is applicable to all norm based optimization 
problems. In discrete-time such a technique was employed in (64] to study a number of issues 
in robust control.) 

We will also discuss our research in combined suboptimal controllers ([36] and 

[38]) as well as sketch an approach for combining other norms based on techniques from 
interpolation on Banach spaces , and the connection of this methodology to a new approach 
for model reduction which we intend to explore in our new AFOSR contract. 

We should note that our work in H°° control has also motivated a number of interpolation 
theoretic problems connected to a strong version of the Parrott theorem [50], and the resulting 
theory of minimal entropy extensions [37]. Moreover, there are a number of interesting oper¬ 
ator theoretic problems connected to the singular spectrum of the four block operator which 
we will describe in this proposal, and which we intend to explore further. Finally, there are 
some deep operator theoretic problems related to the characterization of the optimal solutions 
in spectral interpolation theory [18]. 

In a different direction, we have been using curve evolution theory (and especially invariant 
nonlinear diffusion equations), for the development of new algorithms in image processing and 
computer vision. Curve evolution theory has recently become a major topic of research, and 
indeed has appeared in such diverse fields as differential geometry, parabolic equations theory, 
numerical analysis, computer vision, the viscosity solutions of Hamilton-Jacobi equations, and 
image processing. See [67, 68, 69, 81, 82, 83, 84, 85] and the references therein. 

In particular, evolution equations which are geometric non-linear versions of the classical 
heat equation have received much attention, since these equations have both theoretical and 
practical importance. These ideas have been used also in shape-from-shading, image smooth¬ 
ing and enhancement, motion planning, shape segmentation, optical flow, and a continuous 
implementation of mathematical morphology. 

A complete list of publications which acknowledges support of AFOSR-90-0024 is included 
in Section 7. We now sketch the work done by A. Tannenbaum and collaborators on this 
contract. 

2 Nonlinear Robust Control 

We have been pursuing several directions in order to derive nonlinear generalizations of the 
(linear) H°° theory in the weighted sensitivity minimization (one block), mixed sensitivity 
(two block), and even standard problem frameworks. One such direction is based on an 
iterative commutant lifting theorem [51], [52], [53], [41] which gives an explicit design 
procedure for nonlinear systems and captures the f7°°-control problem for a large class of 
nonlinear plants. We have also defined a notion of rationality for nonlinear systems, and we 
have proven that the iterative commutant lifting procedure produces rational controllers (in 
this nonlinear sense) if we start from rational data [51]. We have thus been able to write 
computer code for this procedure along the lines that was done for the four block problem 
using the theory of skew Toeplitz operators. 
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2.1 Causal Analytic Mappings 

We consider analytic mappings on Hilbert space. For the precise definitions see [51], [52], [53], 
[39]. For simplicity, we will only consider SISO operators in what follows. The multivariable 
case works the same way [39]. We will find it convenient to employ the Fourier representation 
of elements of fT 2 (D n ). 

So we consider an analytic map 4> with Q = H = B 3 (the standard Hardy space on the 
disc D). Note that 

H 3 ®-®H 2 = {H 3 ) 9n *H 3 {D n ) 

where we map 1 ® ® z ® ® 1 (z in the i-th place) to Zi, i = 1 , • • • , n. In the usual way, 

we say that if shift-invariant (or time-invariant) if 

*nS®" = Sfn Vn > 1, 

where S : H 3 -» H 3 denotes the canonical unilateral right shift. (Equivalently, this means 
that S$ = if o S on some open ball about the origin in which <f is defined.) 

Now set 

P li) := P U) ® ® P U) ( n time8 )> 3 > i. » > 1, 

where 

P U) := / - Sis*. 

Then we say that if is causal if 

p u) 4* = i>i. »>i. 

For <f •. H 3 -* H 3 linear and time-invariant, it is easy to see that <f is causal. In the 
nonlinear setting however, time-invariance may not imply causality [53]. It is for this reason, 
that a causality constraint must be explicitly included for nonlinear H°° design. 

2.2 Causal Optimization Problem 

Because of the difficulties involving causality when one applies the classical commutant lifting 
theorem in the nonlinear framework, we will need to formulate a new linear causal opti¬ 
mization problem. Then we will indicate how to reduce the nonlinear generalization of the 
H°° sensitivity minimization problem to a series of such problems. 

We let S( n ) denote the unilateral shift on H 3 (D n ) given by multiplication by (z\ ■ • •). 
Since H 3 (D n ) will be fixed in the discussion we will let S := 5( n ). In what follows, U will 
denote the unilateral shift on H 3 given by multiplication by z, and 0 € H°° will be an inner 
function. Finally W : H 3 (D n ) —» H 3 will denote a causal, time-invariant bounded linear 
operator. 

We can now state the causal H 00 -optimization problem (COP): Find 

a := inf{||W - 0Q|| : Q : H 3 (D n ) -» S 3 , Q causal, time-invariant}. (1) 
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Moreover, we want to compute an optimal, causal, time-invariant Qopt such that 

0 = 11^-0^11. (2) 

If we drop the causality constraint, the solution to problem (1) is provided by the classical 
commutant lifting theorem [89]. With the causality constraint, the solution to (COP) is 
abstractly provided by a causal commutant lifting theorem [54], [42], [40]. 

Our constructions are based on a reduction theorem [39], which we will briefly sketch 
below. In order to formulate this result, we will first discuss the Fourier representation. 

Fourier Representation 

We need to define all the relevant spaces. Denote by 
l\H 2 ) 

»=i 

the Hilbert space of all column vectors 

/(*) = [A(*)» /a(*)> • • - ,/»(*), • • (3) 

(' stands for tranpose) such that 

ll/ll’.-EMI’. (4) 

*=1 

is finite. (|| |( is our generic symbol for a Hilbert space norm (2-norm) as well as the induced 
operator norm. So for example in (4), it stands for the usual norm on H 2 as well as the 
associated norm on t a (H a ).) Thus l a (H a ) is a vector-valued Hardy space. Indeed, if }(z) is 
given by (3), then we may write 

/(*) = Y 0m2 ' Tn » ( 5 ) 

m=0 

where each dm is an infinite column vector with components in C, and 

«-=.jf , (o),..i'. 

Clearly, 

n/n j =f: imi 1 - 

m=0 

Conversely, if f(z) € l 2 {H a ) is given in the form (5) for 

®m = [®ml > • • • j !■••]) 

then f(z) can be written in the form (3), i.e., 

/(*)=[/i(*),. r. 
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where 


fj( z ) = £ «m jz m . 

m =0 

In whet follows, we will either use representation (3) or (5). The context should always make 
the meaning clear. 

Next we let S* : 0(E 3 ) -» l 3 (H 2 ) denote the unilateral shift defined by multiplication by 
z. Then the Fourier representation is given by the (linear, bounded) operator 

$:=$„: E 2 (D n ) -> l 2 (E 2 ), 

which is defined by 

Fm,m .m+1 

■fra+2 i m,...,m 

where 

.*.)= E Fn.:*.#- 

u.—A»>o 

Note that we are taking f(z) in the form (5) in the above representation. Moreover, note that 

n\D~)={F(z l . *)« £ «._**?•••*: E ««..*.ll’<»}. 

.. »«>0 *i >0 

We can also write 

M = [/0...J.W, /1....0W. A,A,..,oW, ■ • ■]'. (?) 

where 

fix .*»( z ) := Xrf ^*l+ m .in+m^ m . (8) 

Notice, we have chosen the indexing of the /,,. i n in such a way that the indices run over 

the set 

J»:={(*i....,*»):*i,•••,*» >0, min{*i,...,*n} = 0}. (9) 

Next, it is easy to prove that $ : E 2 (D n ) -* 1 2 {E 2 ) is unitary, and that 




#5 = S**. 


( 10 ) 







By (10), we see that if W : H 3 (D n ) -* H 3 is such that WS = UW, then the operator 
Wi* : l\H 3 ) -> H 3 satisfies 


(W§*)S* = WSi* = U{Wi*) t 

that is, Wi* intertwines the shifts S* and U. Consequently, it is standard that Wi* is 


represented by a row vector 

[Wo . o(z), Wi . l0 (z),.... Wo .i(z), W 3i ...,o(z ),...]. (11) 

We will write that 

Wi* a [Wo.,o(*)> Wi,.., 0 (z),..., Wo,..,i(z), W 2 ,.., 0 («),...]. (12) 

One may show that in fact 

Wi, . i K {z) = W(z‘ l • • .<•), (n,.. .,*n) 6 /„. (13) 


The above discussion used only the time-invariance for W. In the next proposition, we 
will write down an explicit expression for the row vector of (13) associated with Wi* in case 
W is causal. 


Proposition 1 Let W : S 3 (D n ) -» H 3 be time-invariant. Then W is causal if and only if 
Wi .*.<*) = .V(i,.i.) 6 /„ 

By the above discussion (in particular, Proposition 1), we see that for W, 0 as in the 
(COP) problem (1), we have 

o = inf{||W - 0Q|| : QS = UQ,Q causal, time-invariant} 

= inf{||W$* - 0(?$*||: (Q§*)5* = U{Qi*),Q causal, time-invariant} 

= inf{||Wi - ©QiH : W 1 ,Q l :l 3 (H 3 ) -» H 3 , W x = Wi*, 

Qi - [qo,...,o{z),zq l . o(z),.-.,zqo . i{z),z 3 q 2 . 0 (*),• • •]}• 

From now on (unless explicitly stated otherwise), we will just work with the operators 
W\,Q\ : 1 3 {H 2 ) —* H 3 . Essentially, via the unitary equivalence i, we are identifying the 
spaces H 3 (D n ) and l 3 (H 3 ). In particular, we identify W with W, = Wi*, and Q with 
Qi = Qi*. For simplicity of notation, we will denote 

W = Wi, Q = Q 1 . 

The context should always make the meaning clear. 
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We now translate the notions of causality and time-invariance for an operator W : 
0{H 2 ) —> H 2 . We will say that W is time-invariant if WS* = UW, that is, 

w a [Wo.o(*), w,.o( 2 )i.... w 2 .,o(z),...]. 

Moreover, we say that W is causal if the operator W$ : H 2 (D n ) —» H 2 is causal, which means 
(see Proposition 1) that 

W S [W 0 c .... (0 (a), ^.. i0 (r),..., zW 0 '... >1 (z), z 2 W a ‘..., 0 (z),...], 

for some 

W.*.(») 6 H-.,40€t.}. 

Motivated by the above discussion, for W : f 2 (H 2 ) -* ff 2 time-invariant and causal, we 
introduce the operator 

Wc 2 [Wo i „. i o(z), Wf -i0 (z),..., Wo > .„ >1 (z), Wj_ >0 (z),...] 

= [Wo .o(«), Wi,„., 0 (z)/z,.... Wo.i(z)/z, W 2 ,..,o(z)/z 2 ,...]. (14) 

Recapping, in order to solve the (COP) problem (1), we can equivalently solve the following 
problem: Given W : 1 2 {H 2 ) -» J7 a time-invariant and causal as above, find 

<f = inf{||W - ©<?|| : QS « = VQ, Q causal}. (15) 

Thus we have to solve the optimization problem (COP) on the Fourier transformed op¬ 
erators. But this can be easily accomplished via the following key result that we proved in 
[39], 

Theorem 1 (Reduction Theorem) Notation as above. Then 

o = inf{||W - 0Q|| :QS= UQ, Q causal) (16) 

= inf{||[W 0 . 0 (*) - ©9o,...,<>(*), *(Wi,o,..,o(z) - 0 9l , 0 .,o(z)),.. ,]|| : (17) 

l9o .o (z),..., ?2 . 0 (z),...)eC(l 2 {H 2 ) > H 2 )} 

= inf{||W e — 0<?|| : QS = UQ}. (18) 

(Note in (17) the norm is the operator norm in C(t 3 (H 2 ),H 2 ). In general, for Hilbert spaces 
Ti and 1C, C(H,K) denotes the space of bounded linear operators from H to K.) 

Algorithm for Computation of o 

We would like to summarize the above discussion with a high-level algorithm for the com¬ 
putation of the optimal causal performance o , and corresponding causal optimal interpolant 
Q°n in (1) and (2). 









First of all using the notation of the Reduction Theorem, let us denote 

o 0 := inf{||W e — 0<J|| : QS = UQ}. (19) 

(See equation (18).) Then the Reduction Theorem guarantees that 
a = (J 0 - 

This means that a causal optimization problem can be reduced to a classical generalized 
interpolation problem in H°°. 

We can summarize the procedure as follows: 

(i) Let W,0 be as in (1). (Thus W : H 2 (D n ) B 2 here.) We compute W(z\ l ■ ■ z£) 

where (*i, ...,*«)€/„• We get that 


W$* * (Wo.o(*)» Wi,.„ (0 (z),..., W 0 .x(z),W a . q(z), ...], 


and then as above, we can obtain the row matrix 


[Wo .o(*), Wl." 0 (z ),.... W£... (1 (*), W 3 V„ 0 (z),...]. 


(ii) The latter row matrix represents an operator W c : l 2 (H 2 ) -* H 2 . Let II : H 2 -> 
H 2 0 QH 2 denote orthogonal projection. Using skew Toeplitz theory, we can compute 
the norm of the operator 

A(W,0):=nW e . (20) 

The norm of this operator is a, the optimal causal performance. 

(iii) Using the classical commutant lifting theorem and skew Toeplitz theory, we can compute 
the optimal dilation B c : l 2 (H 2 ) -* H 2 of A(W, 0). Recall this means that 

B C S* = UB C , UB C = A(W,Q), ||fl c || = ||A(W,0)|| = o. 

We can then write 

B C = W C - QQ^'O. 

Then from (14), we can find the optimal causal dilation 
B = W$* - QQopt**- 

Note that B and B c are related as in (14), and similarly for Qopt, c and <?opt§*. Qopt ■ 
H 2 {D n ) -* H 2 is the optimal causal interpolant, i.e., 


a = \\W - QQoptW- 










Figure 1: Sensitivity Minimization Configuration 

Nowin analogy to our previous work, we can base an causa] iterative design procedure 
on this chain of id*as. 

Here is how such a procedure would look. Let us call an analytic input/output operator 
<f> : H 2 -* H 2 admissible if is is causal, time-invariant, and ^(0) = 0. Denote the set of 
admissible operators by C a • In what follows below, we assume P,W e C a , and that W admits 
an admissible inverse. 

Referring to Figure 1, we consider the problem of finding 

:= inf sup ||[(J + P o C)~ l o W]v\\ } (21) 

c IMIS* 

where we take the infimum over all stabilizing controllers. (In what follows, we let || || denote 
the 2-norm || || a on H 2 as well as the associated operator norm. The context will make the 
meaning clear.) Thus we are looking at a worst case disturbance attenuation problem where 
the energy of the signals v is required to be bounded by some pre-specified level 6. (In the 
linear case of course since everything scales, we can always without loss of generality take 
6 = 1. For nonlinear systems, we must specify the energy bound a priori.) Then one sees 
that (21) is equivalent to the problem of finding the problem of finding 

Ht = inf sup ||(W^ - P o g)«||. (22) 

«€C.| M1 <, 

The iterated causal commutant lifting procedure gives an approach for approximating a 
solution to such a problem. Briefly, the idea is that we write 

W = W 1 + W a + --- > 

P = Pi + P2+--, 

9 = 91 + ga + • ■ • > 


10 








( 23 ) 


where Wj t Pj,qj are homogeneous polynomials of degree j. Notice that 

« = « t tafJW' i -.P l5l | | + 0(A 

where the latter norm is the operator norm (i.e., S°° norm). From the classical commutant 
lifting theorem we can find an optimal (linear, causal, time-invariant) qi,opt € H°° such that 

t * = 6\\W 1 -P 1 q liOpt \\ + 0(6 2 ). (24) 

Now the iterative procedure gives a way of finding higher order corrections to this lin¬ 
earization. Let us illustrate this now with the second order correction. Indeed, having fixed 
the linear part qi,opt of q in (22), we note that 

W(v) - P(q(v)) - (IVi - P iqi>opt )(v) = 

Wj(v) - Pa(9i,opt(v)) - Piqi(v) + higher order terms. 

Regarding as linear operators on H* ® H 2 ^ H 3 (D 2 , C) as above, we see that 

sup || (W - P o g)(v) - (Wi - Piqi t0p t)v\\ < 6 2 \\W 3 - P a g 2 || + 0(6 3 ), 

IMI<« 

where the “weight" W 3 is given by 

W 3 := W 2 - Pa(gi,opt ® gi.opt)- 

The point of the iterative causal commutant lifting procedure is to allow us to construct an 
optimal admissible ga,opt, and so on. 

In short, instead of simply designing a linear compensator for a linearization of the given 
nonlinear system, this methodology allows one to explicitly take into account the higher order 
terms of the nonlinear plant, and therefore increase the ball of operation for the nonlinear 
controller. Moreover, if the linear part of the plant is rational, our iterative procedure may 
be reduced to a series of finite dimensional matrix computations. (See [39, 51] for discussions 
of rationality in the nonlinear framework.) 

Finally, in a number of interesting cases, the above methodology can be extended to a 
nonlinear extension of the mixed sensitivity problem; see [34]. In fact, one can show that 
for linear weighting filters and admissible plant, the nonlinear mixed sensitivity problem may 
be reduced to a standard linear two block problem, followed by a one block nonlinear design, 
which may be solved using the above iterative methods. 

Recently the above procedure was extended to the general standard problem for nonlinear 
systemr, see [41]. We should note that we have concentrated on time-invariant systems 
in our above description. In fact, there is a much more general causal commutant lifting 
methodology [54, 42, 40] that can be extended in principle to time-varying systems. This 
is a very important problem area. Moreover, there are interesting problems concerning the 
equality of certain invariants which arise the the general causal commutant lifting framework 
[54] which we intend to consider in our upcoming AFOSR contract. 
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2.3 Saddle-Point Approach to Nonlinear Optimization 

We have discussed above an iterative commutant lifting approach to nonlinear system design. 
The iterative communtant lifting technique is basically a local analytic method for nonlinear 
system synthesis. We have also been exploring a very different approach applicable to certain 
systems with saturations based on an interpretation of the classical commutant lifting theorem 
as a saddle-point result [55]. This motivates us to formulate a nonlinear commutant lifting 
result in such a saddle-point, game-theoretic framework. 

A related approach to nonlinear design has already been independently employed in the 
novel and important papers of Ball-Helton [8], [9]. See also the recent nice work in [59, 60]. 

In our research, instead of considering general nonlinear systems we limit ourselves to 
the concrete (but certainly interesting case) of linear systems with input saturations. Such 
systems occur, of course, all the time in “nature.” We should add that a similar approach 
should be valid for many of the hard, memoryless, noninvertible nonlinearities which appear 
in control. 

Mathematically, the case of the saturation is very interesting since in a certain sense it is 
a nonlinear analogue of an inner (non-minimum phase) element, whose “spectrum” seems to 
be spread throughout the unit circle. Thus the problem of sensitivity minimization for such 
elements (that is, a form of weighted inversion) is particularly challenging, and will be a key 
topic to be studied in our upcoming research program. Again, preliminary results along these 
lines have been worked out in [55]. What needs to be developed still is a commutant lifting 
type result valid on convex spaces. This we plan to do in our new AFOSR contract. 

3 Structured Singular Values and /i-Synthesis 

We would like now to discuss our work on the structured singular value and /x-synthesis using 
a novel approach which we developed called structured interpolation theory. The structured 
singular value was introduced into robust control by John Doyle and Michael Safonov ([30], 
[31], [79]) to handle problems involving structured perturbations which includes both H°° 
and the multivariable gain margin as special cases. 

Our starting point is the fact that the problem of internal stabilization of a given LTI 
multivariable plant can be reduced to one of interpolation. Thus the natural measure of 
robust performance in this framework is given by the minimization of the structured singular 
values over all possible interpolants. Hence, one needs a structured Nevanlinna-Pick type 
result which will generalize both the classical Nevanlinna-Pick theorem (relative to the H°°- 
norm), as well as the spectral Nevanlinna-Pick theorem (relative to the spectral radius). Such 
a structured Nevanlinna-Pick theorem can be deduced as a consequence of a general structured 
commutant lifting theorem as we will indicate below. This approach has been developed in 
our AFOSR sponsored work [18, 19, 15, 16, 23, 12]. 

We will discuss some of these issues now, and explain how these results could serve as 
a basis of performing the /x-synthesis procedure in robust feedback control in a rigorous, 
analytical manner. 
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3.1 Structured Singular Values and Dilations 

We would like to formally introduce the structured singular value now, and give some of 
its basic properties. We base this discussion on [20]. Instead of working over diagonal sets 
of matrices as in [30], we can more generally work over an arbitrary finite dimensional C*- 
algebra. 

Let £ be a complex finite-dimensional Hilbert space, and A C £{£) (the space of bounded 
linear operators on £), a C*-algebra. For A £ C(£), A / 0, we define the structured singular 
value 


Ma(A) := [inf{||X||: X £ A, -1 6 a(AX)}]' 1 . 

Moreover, we set 

ft a(A) := inf{||JTAX- 1 || : X £ A'}, 

where A' is the commutator of A. Note that for A = £(£), fi&(A) = ||A||, while for A = CIc , 
H&(A) = ||A||«p (the spectral radius of A). 

We now summarize some of the elementary properties of ha based on Doyle [30]. The 
relevant properties are: 

(i) Ma (A) = sup{||AJf || v : X £ A, ||*|| < 1}. 

(ii) ha is continuous. 

(iii) ha(A) < ft a (A). 

For certain diagonal algebras of matrices, it is argued in [30], [79], and [80] that the 
structured singular value ha is the natural object of study in robust control. Unfortunately 
the structured singular value is difficult to compute, so in practice it is ha which is actually 
used for control problems. It is therefore of interest to know when these two objects are equal. 

In [30], Doyle has shown that in fact ha = Ma w ben the relevant diagonal algebra has three 
or fewer blocks. In [20], we give a very different proof of this fact based on the following result 
which we believe has independent interest. Define the operator M& £ £(£) by Ma •= AX. 
Notice that £(£) may be given a Hilbert space structure with respect to 

(Ti,T 2 > := rr(2JTi), 


where Tr denotes the trace. Define 


Ha(A) := hlWa) 

where 

A := { M x : X £ A'}'. 
We now have (see [20] for the proof): 
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Theorem 2 


fi&(A) ■=**(*)■ 


Note that Theorem 8 implies that can be regarded as a structured singular value 
on a bigger space. From the theorem and property (ii) above, we can immediately infer the 
key fact that is continuous. This result is also strongly connected to some recent work on 
robust stability with respect to time-varying perturbations [86]. In fact, we are investigating 
the extension of this lifting technique to operators on infinite dimensional Hilbert spaces 
with applications to the robust stability analysis of systems under various kinds of structured 
perturbations [13]. In particular, we have considered the following two cases [13,14, 21]: 

(i) The algebra of constant diagonal scales A', with the operator A taken to be analytic 
Toeplitz. (This is the case analyzed in [86].) Note that by “analytic Toeplitz operator” 
A, we mean that A is given by an n x n matrix with entries B°° functions, which we 
regard as acting as a multiplication operator on B 2 (C n ). Thus A defines a stable LTI 
system. We also want to consider general time-varying linear input-output operators 
with this constant diagonal algebra of scalings as well. 

(ii) Again we take A to be analytic Toeplitz, but now we want to consider A' to be the 
algebra of diagonal analytic Toeplitz operators. This is the type of problem considered 
in p-synthesis. 

We should note that this work has also led to a new relative Toeplitz-Hausdorff theorem. 

We will now outline a structured analogue of the commutant lifting theorem [20]. This 
will be applied to the structured version of classical matricial Nevanlinna-Pick interpolation 
below. 

Set 

T := 5(m) ® Ig 

where m is a finite Blaschke product, 5(m) is the compressed shift, and £ is a finite dimen¬ 
sional complex Hilbert space. Fix A C £(£), a C*-algebra. Define 

Ifji ® A := {I H ,®X:XZ A}, 

In* ® A' := { Ijj7 ® X : X £ A'}. 

Notice that H := H 2 (£) © mH 2 {£) reduces both I H i ® A and I H 7 ® A'. Now define for 
A € {T}' (the commutant of T), 

p$(A) := inf{||XAA- 1 ||: X invertible, X € {T}', X £ (I& ® A|£)'}. 

Let U be the isometric dilation of T on B 2 {£) (so that V is defined by multiplication by 
z). For B € {Uy, define 

p$(B) := infflirHy- 1 !! : Y invertible, Y € {VY £ (/*> ® A)'}. 

We can now state the following result from [20]: 
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Theorem 3 (Structured Commutant Lifting Theorem) Notation as above. Then for 
Ae{Ty ’ 

Pr(A) = \nS{pu(B) :B is a commuting dilation of A}. 

Actually, in the finite dimensional case of interest to us, we can show that 
PtM = inf *up/I A (£(*)) 

where B € {U}' is a commuting rational dilation of A. 

3.2 Structured Nevanlinna-Pick Interpolation 

We now apply the above theory to a structured version of the Nevanlinna-Pick interpolation 
problem for matrix-valued interpolants. 

Let £ be a finite dimensional Hilbert space, let zj,..., z„ € D be distinct, and let 
Fu. • •, F n e £{£)■ We begin with the classical matricial Nevanlinna-Pick problem in which we 
want necessary and sufficient conditions for the existence of an analytic function F : D -» C(£) 
with Moo < 1 such that 

n*i)=Fj (») 

for j = Define 



and 

H:= H\£)emH 3 (€). 

We set T := S(m) ® Is , and note that 

n = fi ® £ + h ® £ + • • • + f n ® £■ 

This sum is direct but not orthogonal. 

For the given interpolation data above, we define A : Ti -» H by linearity and by 
MfiQO'-fiQFjt 
for all £ € £, j = 1,2,.. .,n. Note that 

for all £ € £ , j = 1,2,..., n. Thus 

A € { Ty. 
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It is easy to show that F satisfies the interpolation conditions 


( 26 ) 


n*i)=fv. vj = i.» 

if and only if 

PhMf - APh, 

where Mr : B 3 (£) -» B 2 (£) denotes the multiplication operator associated to F. Then 
the classical commutant lifting theorem implies that there exists an F satisfying (26) and 
||F||oo < 1 if and only if ||j 4|| < 1. We will now show that the structured Nevanlinna-Pick 
problem can be given a similar solution, based on the structured commutant lifting theorem. 
More precisely, define 

I := {F : D -» £(£): F is rational, bounded in D, F(zj) = Fj}. 

We are interested in finding 


/x(J) := inf{sup/i A (F(i)):f6Z} 

*€& 

A(X) := inf{sup/i A (F(z)) : F e T). 

*€£» 

We denote the operator A associated with the matrices F if .. ., F n by j4(Fi, ..., F n ). Set 

Pt(A) = 

inf {|| i4( Jlfi fj Aff 1 ,.. ..MnFnAf- 1 )!! : Mj € A', 1 < j < n } 

(where the Mj are invertible) and 

PtMA) = 

sup {p T (A(F l X u ...,F n X n )): \\A(X U ■ ■.X n ) || < 1, X x . X n € A}, 

where as above, for an operator Q € { T }' we let 

pr{Q) = inf{||XQX- 1 || : X is invertible and X € {T}' }. 

It is easy to show that 

Pt(A) > PtA a )- 


We can now state [20]: 

Theorem 4 (Structured Nevanlinna-Pick) Notation as above. Then 

«z)=*>#:• i)- 
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Theorem 5 Notation as above. Then 


mC 1 ) > ptA a )- 

Next in many control problems one is interested in a variant of Nevanlinna-Pick inter¬ 
polation, called tangential Nevanlinna-Pick interpolation. In the tangential problem, we are 
given * 1 ,.. •, *n € D (which we take to be distinct for simplicity), itj,..., u„ € C N non-sero 
vectors, and vi,...,v n G C N arbitrary vectors. We are then interested in those bounded 
analytic functions F : D -+ C(C N ) which satisfy the interpolation conditions 

F(zj)vj = vj, j = 1,...,». (27) 

In the classical Nevanlinna-Pick problem, we ask for conditions guaranteeing the existence of 
an interpolating function F with 

Halloo := .up{||F(*)|| : Z e D) < 1. 

In [15], we study the spectral version in which we require 

||-F|U> := «up{||^(z)||^ :zeD}<l. 

Define the tangential Nevanlinna-Pick matrix as follows (for p > 0): 

//(*,.[ <W.^T<^.*) ] 

L 1 Z 3 Zk J l<j,k<n 

The following result may be deduced as a coroUary of a tangential spectral commutant lifting 
theorem [15]: 


Theorem 6 (Tangential Nevanlinna-Pick Theorem) There exists F £ H°°(C N ) with 
Ill’ll*? < P satisfying the interpolation conditions (21) if and only if there exist X , 6 B(C N ) 
(1 < j <n) invertible such that 

■M'(zi,---,Zn,XiUi,Xiv l ,...,X n u n ,X n v n ;p)>Q. 


Work is already in progress on the two-sided and bitangential spectral and structured 
analogues of the classical results [12]. These results are precisely what are needed for a 
completely rigorous ft-synthesis procedure in robust control. 
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3.3 Conformal Mappings 

W« would like to briefly discuss tome work that we alio did on the gain-phase margin problem 
that involve! some novel approximation methods of Riemann mappings (conformal equiva¬ 
lences from a simply connected proper subset of C to the unit disc) due to Marshall-Morrow 
(see [27] and the references therein). 

The successful solution of the gain and phase margin problems (see [90], [66], [32]) was 
based on the fact that one could explicitly construct a conformal equivalence from a simply 
connected subdomain of C (which was associated to the uncertainty model) to the disc. 
Nevanlinns-Pick interpolation then took care of the rest. In [66], we considered a combination 
of both the classical gain and phase margins in order to arrive at a better measure of robust 
stability which we called the gain-phaae margin. Unfortunately, in this case, there is no 
explicitly computable conformal equivalence between the associated domain of uncertainty 
and the disc. The algorithm of Marshall-Morrow however gives a fast way of approximating 
the given equivalence, and has led to a reliable approximate solution of gain-phase margin in 
[27]. We are now applying this algorithm to the type of general robust synthesis question as 
considered by Sideris and Safonov in [87]. 

3.4 Problems in Classical Interpolation Theory 

We would like to mention a direction in our research which involves some interesting problems 
in classical interpolation theory, in particular, the minimal entropy solutions for a number of 
interpolation problems [50], [37]. We have found that in studying the spectral properties of 
the four block operator and its relation to interpolation theory, we have been led to a strong 
version of the classical Parrott’s theorem. Parrott’s theorem is one of the key matrix 
extension results and has found numerous uses in control theory as well as signal processing. 
Our strengthened version in a certain sense picks out an extension which is “opposite” to 
the famous maximal entropy or central solution to such extension problems. This solution 
has a natural physical interpretation in the waves through multi-layered media context. 
Prom the more theoretical side, this result can be used in generalizing some beautiful results 
of Adamjan-Arov-Krein on the connection of the singular values of the Hankel operator to 
optimal interpolation by functions with a presribed number of poles on the unit disc to the 
four block operator of H°° control [46]. 

Further, based on the strong Parrott theorem we have proven a strong version of the 
commutant lifting theorem [37] which leads to an explicit parametrization of minimal en¬ 
tropy solutions in dilation theory. We would like to apply this to the Nevanlinna-Pick and 
CjpratheodoTy interpolation problems (and even to the general standard H°° problem), in 
order to explore the system theoretic consequences of this class of dilations. 

4 H°° Optimization of Distributed Systems 

In [73], [74] we have considered the mixed sensitivity ^“-optimization problem for distributed 
plants with a finite number of unstable poles. 
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Figure 2: Standard Feedback Configuration 


As in the standard operator approach to such problems, the computation of the optimal 
performance and corresponding optimal controller is reduced to a finite dimensional matrix 
problem. In the stable case, the size of the matrix only depends on the McMillan degree 
of the weighting filters. In the case of unstable plants, the size of the corresponding matrix 
depends on the number of right half plane poles of the plant as well. The dimension of this 
matrix can be computed a priori. The key mathematical fact that we use is that the skew 
Toeplitz operators which we obtain in the unstable case are finite rank perturbations of the 
classical skew Toeplitz operators obtained from compressions of rational functions. 

In our AFOSR research, we have used these techniques to synthesize controllers for several 
types of flexible structures [70], and an unstable delay system derived from the flight control 
of the X-29 [35]. 

4.1 Two Block Problems With Unstable Plant 

In this section, we will show that several two block If “-minimization problems reduce to the 
computation of the norm of a certain skew Toeplitz operator, and indicate how this norm 
may be computed. We begin with some notation. The Hardy spaces H 2 and B°° are defined 
on the unit disc as above. We denote 

RB°° := {rational functions in fT“} . 

We consider the feedback configuration of Figure 2 with 


G_ 

G d 


and G n € R°°, G d € RH *°. 


We assume that (i) G n = rrinGno, where m„ 6 H°° is inner (arbitrary) and G n o € H°° 
is outer, and (ii) G n , G d have no common zeros in the closed unit disc. We also write 








G d — rn^Gjo where m d € RH 90 is inner and Gdo € RS°° is outer. Under these assumptions 
there exist X € RB°° and Y € B™ such that 

XG n + YG d = 1. (28) 

(To construct solutions of (28), X must be chosen to satisfy a set of interpolation constraints 
at the seros of G d in the dosed unit disc so that Y = (1 - XG n )/G d belongs to B°°. Since 
the constraints are finite in number, X can always be chosen to be rational.) The set of all 
controllers which stabilize the plant can now be written in the form 
r X + QG d 
C ~Y-QG n 

for some Q € B". Now let 5 := (1 + PC) -1 and note that 


5=1- XG n - QG n G d . 

In [73], [74], we show that the computation of 

where W\, W 2 € RB°° are given weighting functions with Wf \ W 2 l € RH°° 
to computing the norm of the operator 

A ._ | **■(-.)("MS)-SWSHS)) j_ 


(29) 

may be reduced 

(30) 


where S : B 3 -* H 3 denotes the unilateral shift, 21(171*) := B 3 0 m*N 2 and P n(m,) the 
orthogonal projection onto B{m n ,), for m,m, inner functions assodated to the plant and 
weighting filters, and where Wq,Wq,G 0 are rational 2T°° functions computed from the plant 
and weighting filters. This reduction is true for plants with arbitrary outer parts. (We can 
do a similar type of reduction for another two block minimization problem in case the outer 
part of the numerator of the plant is rational. Namely, in this problem we are required to 
find 

^.uJSLgJf W 2 CS 11 ’ 


where Wi, W 2 € RH°° are given weighting functions with Wf 1 , Wj 1 € RH°°.) 

In [73], [74], we develop an approach to computing the singular values and vectors of 
operators of the form (30). We remark here that it is easy to compute the essential norm 
(see [73], [74]) of the operator A, which will be denoted by ||A||«. Then in [74], the following 
result is proven: 


Theorem 7 Let n denote the maximum of the McMillan degrees of the weighting filters W 2 
and W 2 , and let l denote the number of unstable poles of the plant P. Then the singular 
vectors and values of A which are > ||A||« may be derived from an explicitly computable 
system of in + 21 linear equations (the *singular system”). 
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In [74], the singular system of equations is explicitly written down. Again the number 
of equations only depends on the McMillan degrees of the weighting filters, and the number 
of right half plane poles of the plant. The computation of the maximal singular value and 
the associated singular vectors of A, then allows us to find the optimal performance /x of our 
original control problem and the corresponding optimal compensator. 

As an example of the above, consider the plant (in continuous time) with a delay and one 
unstable pole: 

' as - 1 

The optimal unweighted mixed sensitivity performance can be computed to be 

H - e h/v \Jl + yfl -e-W*. 

It is interesting to note that as h -* oo, and/or a -> 0, the best achievable performance 
increases exponentially, as expected. In [35], a more complicated (and realistic) delay problem 
is worked out using the above methods. 

Of course, we would now like to extend the above techniques to unstable distributed 
multivariable plants in the full four block setting. Research is now proceeding along these 
directions in our new AFOSR contract. Moreover, we are very interested in working out 
more benchmark examples in addition to the flight control problem [35] and flexible beam 
problem [70] to which we alluded above. A key part of the implementation will be to have 
an efficient way of generating sub-optimal finite dimensional compensators for such problems. 
This important area is also being investigated. 

4.2 Young’s Operator 

A key difficulty involved in reducing the standard problem to the four block problem is the 
various kinds of factorizations that must be performed. In fact, one of the major advantages 
involved in the recent state space methods [33] is that these factorizations may be avoided. 
Of course as mentioned above, one of the disadvantages of these state sp ^ce methods is that 
their practical applicability to distributed systems seems to be very difficult. (On an infinite 
dimensional state space one gets infinite dimensional, i.e., operator valued Riccati equations. 
See [28, 29].) 

We have recently begun developing a technique which would avoid a number of the prob¬ 
lems with such factorizations (especially in the multivariable distributed case [75]), as well 
as allow the utilization of our frequency domain “skew Toeplitz” methods to distributed sys¬ 
tems. First of all, recall that via the Youla parametrization, the standard problem may be 
formulated as finding 

^wjr,-rrfiilU 

where Ti,T 2 ,T 3 ,Q are matrix-valued H°° functions of compatible sizes. More precisely, let 
Ei>?i denote finite dimensional complex Hilbert spaces for i = 1,2. Then we take T\ e 
H°°(£uS 2 ), T % € H°°{F 2 ,£ 2 ), T 3 e B°°(£ i,*i), and the parameter Q € B 00 ^,^)- (In 
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general, for two complex separable Hilbert spaces £ t T we define E°°(£,F) to be the space 
of all uniformly bounded analytic functions in the open unit disc, whose values are operators 
from £ to F.) We assume that T 3 is inner, and that T 3 is co-inner. 

Define 

*1 == L\£x)QnK\7 1 ), 

H 2 := L\£ 2 ) 0 T 2 E 2 (? 3 ), 

where K 2 {?\) is the orthogonal complement of E 2 {T\) in L 2 [?\). Define the operator (see 
[94], [36]) A : Hx - U 2 by 

A/ := EhJxS 

where Ph 2 denotes orthogonal projection on 7i 2 . Then using the commutant lifting theorem, 
one may show that 

<? w - ||r l -T 3 Qr 3 m = ||A||. 

We would like to be able to compute the optimal performance and parametrize the optimal 
compensators directly from the Young operator along the lines of the methods that we followed 
for the four block problem [44], [45], [75]. To do this would be a great advantage since we 
would no longer have to go through the messy transformation of the standard problem to 
the four block form. We are now developing a straightforward way of computing the E°°- 
optimal performance and compensators with the Young operator based on a certain triangular 
representation of the operator. 

4.3 Mixed Norm Suboptimal Controllers 

One of the main themes in modem control theory is the utilization of norm based criteria to 
measure the optimal performance of a given control system. (See [32] for detailed discussions 
on this topic.) Two of the most important norms employed in modern control analysis and 
design are the J5T a -norm and the H°°-norm. Indeed, the E 2 -norm is the basis of classical 
quadratic optimal control, while the E°°-norm appears in modem robust synthesis (and 
implicitly in the more classical loop shaping methods [32]). 

We have been investigating combining the advantages of both H 2 and E°° control in [38]. 
(See also [36], [65]) for extensive lists of references on various approaches to mixed norm 
control.) Our starting point is a nice result of Kaftal-Larson-Weiss [62] which guarantees 
the existence of an interpolant which simultaneously satisfies an H°° and E 2 suboptimality 
criterion. Using the theory described in [43] on suboptimal E°° interpolants, we can then 
give an explicit way of computing the combined E°°-E 2 suboptimal interpolant in a given 
H°° problem. 

More precisely, for c € L°° % set d«>(c) := distance(c, E°°), and d 3 (c ) := distance(c,E 2 ). 
(Note that all of our Hardy spaces are defined on the unit disc here.) Then for any 6 > 1, it 
is proven in [62] that there exists <f> 6 E°° such that 

Ik - MU < W. Ik - Mb < • (si) 
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In cue, m,w£ H°° with m inner, and w = pfq rational, using skew Toeplitz theory [38] 
one may explicitly construct <j>, i.e., if c := mu>, then we can find <p € E°° satisfying 

||Ww - ^||oo < Woo(c), ||mu/ - 0|| 2 < (32) 

Indeed, let p := Sd^c), and let 

K :=/» 2 ?(T)*9(T)-p(T)*p(T) 

be a skew Toeplitz operator. Let g$ denote the function in E°° defined by 

at := - mm(0)). (33) 

Then the function 


w - m<f> = Bs = 


mm(0) + q(T)g s 


(34) 


satisfies (32). Explicitly, <p = -W(B« - tu) € E°° and 


The skew Toeplitz approach is the only procedure of which we are aware to compute a 4> 
satisfying (32) when m is irrational. Further, let n := max{degree p, degree q}. Then, if m 
is Blaschke product of order k where n is small and k is large, the methodology just outlined 
provides a numerically efficient method for computing the function <f> satisfying the Kaftal- 
Larson-Weiss constraints (32). However, if this is not the case and m is rational, then the 
state space methods in [36] to compute a <f> satisfying (32) may be more efficient. 

Since as it turns out that the combined H°°-H 3 interpolant is a central solution, these 
interpolants are well-known to be numerically robust, and leads to an interesting class of 
combined E°°-E 7 controllers for feedback systems. We are now actively investigating the 
properties of these controllers, as well as extending these results to find a computational 
procedure for the full standard problem setting for distributed MIMO systems. 

Further, we have found a new method for constructing the central solutions as related 
to the general E°° standard problem in the multivariable case. We are now in the process 
of exploiting this technique for the explicit parametrization of the suboptimal controllers for 
multivariable distributed By stems. This would give a powerful alternative method to the 
one-step extension techniques we have been previously using. 

Finally, we are interested in combining other types of norms in control, for example, L 1 and 
E 00 . A possible method for doing this can be based on some new results on interpolation in 
Banach spaces due to Pisier [78] and Janson [61]. In fact, this methodology can also have 
some nice applications to model reduction (relative to “best” Hankel norm approximations), 
which is certainly a direction which we intend to explore. 


23 









5 Image Processing and Computer Vision 


We have been doing extensive research into image processing and computer vision, and the 
use of these methodologies in visual tracking. We are very interested in understanding how to 
use visual information in a feedback loop. In order to give the reader a flavor of this work, we 
will concentrate on a theory of scale-space that we developed for planar shapes [81, 82]. In this 
work, we combine the three important theories of scale-spaces, affine invariant descriptors, 
and curve evolution, in order to define a new affine invariant scale-space for plane curves. This 
scale-space is obtained from the solution of a novel curve flow, which admits affine invariant 
solutions. Our other work in vision covers a new theory of shape [67, 68, 69], as well as new 
methods for affine invariant image processing and analysis [83, 84, 85]. 

Multi-scale descriptions of signals have been studied for several years already. A possible 
formalism for this topic comes from the idea of multi-scale filtering which was introduced 
by Witkin [93], and developed in several different frameworks by a number of researchers in 
the past decade. The idea of scale-space filtering is very simple and can be formulated as 
follows: Given an initial signal $o(X) : R n —* R m , the scale-space is obtained by filtering it 
with a kernel K{X,t) : R n -* R m , where t £ R + represents the scale. In other words, the 
scale-space is given by t) defined as 

»(£,() w (35) 

where (!*(.,*)[•] represents the action of the filter £(•,<). Larger values of t correspond to 
images at coarser resolutions. 

It is important to note that not every kernel can be used in defining a scale-space. Indeed, 
several conditions need to be imposed on the signal ¥(,X,<) (and therefore on the filter¬ 
ing operation (35)). One of the most important is that of causality, which states that no 
“information” is created when moving from fine to coarse scales. 

A famous example of a kernel which satisfies the required conditions is the Gaussian kernel. 
In this case, the scale-space is linear, and the filter in (35) is just defined by convolution. The 
Gaussian kernel is one of the most studied in the theory of scale-spaces. It has some very 
interesting properties, one of them being that the signal ¥ obtained from it, is the solution 
of the heat equation (with ¥ 0 as initial condition) given by 


(For more details about the Gaussian scale-space, see the aforementioned references.) 

One of the key facts that can be gleaned from the Gaussian example, is that the scale- 
space can be obtained as the solution of a partial differential equation called an evolution 
equation. This idea was developed in different works for evolution equations different from 
the classical heat equation. In what follows, we will describe scale-spaces for planar curves 
which are obtained as solutions of nonlinear evolution equations. 

The second fundamental concept which we would like to emphasize is that of invariant 
descriptor. An invariant descriptor is a property of an object, which does not change when the 
object undergoes certain transformations. More precisely, a quantity Q is called an invariant 
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of a Lie group Q if whenever Q transforms into Q by any transformation j 6 5, we obtain 
Q = QQ, where 0 is a function of g alone. If 0 = 1 for all g € 0, Q is called an absolute 
invariant. 

For example, the area is a global absolute invariant descriptor of the Euclidean group 
(rotations and translations) for planar domains. This means that two planar domains related 
by an Euclidean motion have the same area. The well-known Euclidean curvature given as 
a function of arc-length is a local absolute invariant of the Euclidean group, and a relative 
invariant of the similarity group. We should add that the development of invariants of viewing 
transformations (Euclidean, similarity, affine, and projective maps) has received extended 
attention from the computer vision community in the last years. The topic is very important 
in areas such as object recognition. 

A special class of invariants iB given by the differential invariants which are based only 
on local information, and are useful for the representation and recognition of objects under 
partial occlusions. An example of this kind of invariants is the Euclidean curvature mentioned 
above. The theory of differential invariants is classical and goes back at least to the work of 
Gauss on Euclidean geometry. Much of the recent related work in computer vision is based 
on those old theories. In our work, we have been especially interested in affine differential 
invariants. 

The third component of our work comes from the theory of plane curve evolution. Here 
the curve regarded as the boundary of a planar domain, deforms in time. This deformation is 
governed by a partial, usually nonlinear, evolution equation. Different evolution equations can 
model different physical phenomena, such as crystal growth, the Huygens principle, and curve 
shortening processes. The theory has been well studied in areas such as computational physics, 
differential geometry, numerical analysis, and parabolic equations. We have introduced these 
ideas into computer vision in [67, 68, 69]. 

Motivated by the importance of affine transformations in computer vision, a new theory 
of affine curve evolution was recently developed [81, 82, 83, 84]. This theory, based on affine 
differential geometry and the theory of parabolic evolution equations, constitutes the basis 
of the work on multi-scale representations of signals and image processing in general. This is 
based in turn on a new nonlinear evolution diffusion equation which admits affine invariant 
solutions. The solution of this evolution equation determines an affine invariant scale-space 
for planar curves. Efficient computer implementation of this theory is possible due to a 
recently developed numerical algorithm for curve and surface evolution. In our continuing 
AFOSR research, we will be employing these algorithms to a number of problems in active 
vision, and visual control. 
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